Extended collective I/O for efficient retrieval of large objects
نویسندگان
چکیده
Object-relational databases management systems (ORDBMS) extend the capabilities of the relational databases by allowing definition of new data types and methods to operate on these data types while retaining most of the relational model semantics. In this paper, we examine issues related to parallel processing of queries in object-relational model with respect to efficient storage and retrieval of large objects. We extend the concept of collective I/O and other related techniques like request merging and data sieving in the database domain to achieve high performance in retrieval of large objects. We deal with the I/O optimization problem in the query executor, access methods and the low level runtime system. We also propose a new technique called pooled striping for efficient storage of large objects on multiple disks. The results presented in this paper clearly show the effectiveness of the proposed I/O optimization techniques in handling large amounts of data in a parallel object-relational database system.
منابع مشابه
Orthrus: A Framework for Implementing Efficient Collective I/O in Multi-core Clusters
Optimization of access patterns using collective I/O imposes the overhead of exchanging data between processes. In a multi-core-based cluster the costs of inter-node and intra-node data communication are vastly different, and heterogeneity in the efficiency of data exchange poses both a challenge and an opportunity for implementing efficient collective I/O. The opportunity is to effectively exp...
متن کاملEnwrich: a Compute-processor Write Caching Scheme for Parallel File Systems Apratim Purakayastha 2 Enwrich: a Compute-processor Write Caching Scheme for Parallel File Systems *
Many parallel scientific applications need high-performance I/O. Unfortunately, end-to-end parallel-I/O performance has not been able to keep up with substantial improvements in parallel-I/O hardware because of poor parallel file-system software. Many radical changes, both at the interface level and the implementation level, have recently been proposed. One such proposed interface is collective...
متن کاملCaching Scheme for Parallel File Systems
Many parallel scientific applications need high-performance I/O. Unfortunately, end-to-end parallel-I/O performance has not been able to keep up with substantial improvements in parallel-I/O hardware because of poor parallel file-system software. Many radical changes, both at the interface level and the implementation level, have recently been proposed. One such proposed interface is collective...
متن کاملExtended Two - Phase Method forAccessing Sections of Out - of - Core Arrays
A number of applications on parallel computers deal with very large data sets that cannot t in main memory. In such applications, data must be stored in les on disks and fetched into memory during program execution. Parallel programs with large out-of-core arrays stored in les must read/write smaller sections of the arrays from/to les. In this paper, we describe a method for accessing sections ...
متن کاملRadiative heat transfer: many-body effects
Heat transfer by electromagnetic radiation is one of the common methods of energy transfer between objects. Using the fluctuation-dissipation theorem, we have studied the effect of particle arrangement in the transmission of radiative heat in many-body systems. In order to show the effect of the structure morphology on the collective properties, the radiative heat transfer is studied and the re...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1998